Method and apparatus for reproducing operation guidance information, and method and apparatus for reproducing multi-media information

ABSTRACT

An information reproducing method and an apparatus therefor, by which operation guidance information may be automatically used without bothering an operator, includes a reproduction control unit for reading the operation guidance information depending on an event from a database when the event requiring measures taken by the operator occurs in an object apparatus to controllably reproduce the operation guidance information, and a reproducing unit, which is a terminal connected to the object apparatus to be able to manage the object apparatus, for reproducing the operation guidance information and notifying it to the operator. The operation guidance information about measures that should be taken to a condition of the object apparatus changing with a progress of the measures taken by the operator is reproduced at the terminal apparatus. These method and apparatus are applicable to a method and an apparatus used for reproducing various operation guidance information or multi-media information.

BACKGROUND OF THE INVENTION

1) Field of the Invention

The present invention relates to a method and an apparatus forreproducing operation guidance information or multi-media information.In particular, the present invention relates to a method and anapparatus for reproducing operation guidance information depending on anoccurring event when the event which needs measures taken by an operatoroccurs in an object apparatus, and a method and an apparatus forreproducing multi-media information (including the above operationguidance information) including image information and sound information.

2) Description of the Related Art

If any trouble (an error, a necessity of medium supplement, etc.)occurring from a physical cause, which is not bug of a computer, occursto a main apparatus or a peripheral equipment and there is a necessityfor any recovery work by an operator, or the operator (a user) needs anoperation guidance with or without a trouble, an operation guidancescreen (a help screen) is displayed on a display of the main apparatusor on a display of the peripheral equipment, in general.

In this operation guidance screen, there is shown an explanation by adisplay of symbols or sentences. The operator treats the main apparatusor the peripheral equipment by referring to this screen. The operatoroperates an input means such as a keyboard, a mouse, etc. with aprogress of the measures taken to the main apparatus or the peripheralequipment, and proceed a display in the operation guidance screendisplayed on a display unit.

However, if the operation guide is an explanation or the like by symbolsor sentences, the operator has a difficulty in comprehending actualoperation.

In order to provide more comprehensible operation guidance, a techniquefor reproducing operation guidance information (help information)through multi-media using image displays and sound outputs has rapidlyspread in recent years. However, a function to display detailedoperation guidance information is rarely provided to the individualperipheral equipment such as a printer. For this, it is difficult forthe operator to grasp an actual operation.

According to the operation guidance information reproducing techniqueabove-described, the operator needs to operate a keyboard, a mouse orthe like to input any instruction every occasion when the operatorrefers to a guidance of an operation that the operator should performnext with a progress of measures taken to the main apparatus or theperipheral equipment. This is extremely troublesome.

If a number of users use the apparatus, it is desirable to provide helpinformation depending on a level of skill of the user. If basicinformation is provided to a user in a senior level for a long time, orhelp information in which a lot of technical terms are used is providedto a user in a beginner level who has no knowledge about the apparatus,the user might be forced an inefficient work.

As means to provide help information in different degrees of difficultyand detail depending on a level of skill of a user, there have beenknown a technique in which the apparatus judges a level of skill of theuser and stores it, a technique in which the user inputs his or herlevel of skill to the apparatus, or a technique in which a level ofskill of individual operator is managed on the basis of a personal IDinformation such as an operator card.

However, the technique in which the apparatus judges a level of skill ofeach user and store it in order to provide help information in a levelof difficulty and detail meeting a level of the operator has a problemthat this technique is applicable to an apparatus which is used by asole and the same operator any time. If another user tries to use a helpfunction of this apparatus, help information not conforming to a levelof this user is reproduced, thus it is hopeless that the user caneffectively use a help function.

In relation with the technique where the user inputs his own level ofskill into the apparatus, the user needs to specify as to which levelthe user himself or herself corresponds before watching an actual helpinformation. If the user calls help information of a certain level towhich the user considers that a skill of the user corresponds to, butcontents of this is too difficult for this user, the user needs toreturn to a screen for selecting a level and again select the helpinformation in a level for beginner.

According to the technique managing a degree of skill depending on askill of individual operator based on a personal ID information, theapparatus simply stores a degree of skill of the operator. If the useraccidentally forgets an operation on that day which the user could do inthe past, or the user forgets the operation since a considerable timehas been elapsed since he or she operated last, the user needs to selecta level of the help information again after all. It is hard to say thatthis method is perfect.

Particularly, in the case of an apparatus in which an error occursinfrequently (such as a cash depositing/paying machine in bank under anobligation that, for example, a medium is supplied at a fixed timeeveryday), it happens often that the operator could operate the lasttime, but cannot this time. If a level of skill of a user is decidedfixedly and a help information according to the level is reproduced, aninefficient work might be forced to the user.

There is, therefore, a demand for a technique in which a user can usehelp information meeting a level of the user by selecting a level of thehelp information in a hierarchical configuration as in a step-by-stepdown fashion, while referring to contents of the help informationcategorized in different levels of difficulty. There is also a demandfor a development of a system by which the user can automatically usethe help information while confirming a progress of recovery with theaid of mechanical sensors without troubling the user himself or herself.

If plural events such as errors occur simultaneously, the operationguidance has been given for each event. It is very ineffective that theuser takes measures for each event. In the worst case, it might happenthat the user needs to do a work twice, which can be omitted if an orderof work is taken into consideration. Therefore, there is a demand for atechnique which can realize reproduction of help information indifferent levels of difficulty and detail depending on a skill of theuser, and can cope with error in the most efficient order without a needto repeat the same operation by omitting a useless work if plural errorsoccur.

The above-stated multi-media used for guidance of an operation or thelike has been spread in recent years, particularly. As a result, amulti-media title for providing multi-media information or a reproducingapparatus used therefor become quickly popular. Typically, the user atthe end of the multi-media (an end user) can use the multi-mediainformation only along a scenario prepared in advance by a multi-mediatitle producer.

However, interactivity of information is a material element that decidesa spread of multi-media softwares. It is desired that the end user canuse only a desiring information reproduced, in a mode meeting a demandof the user and efficiently, not only being provided a scenario preparedby a producer of the multi-media title. The multi-media title requires aconsiderable large storage capacity. For this, it is impossible to use aportable small capacity storage medium such as a floppy disk for themulti-media title.

SUMMARY OF THE INVENTION

To overcome the above problems, an object of this invention is toprovide an operation guidance information reproducing method and anoperation guidance information reproducing apparatus, by which operationguidance information can be automatically used so as to improve theefficiency of an operation, and which can reproduce the operationguidance information efficiently even if plural events requiring anoperation guidance occur. Another object of this invention is to providea multi-media information reproducing method and multi-media informationreproducing apparatus, by which the user can readily produce andreproduce a multi-media title, and watch and listen efficiently onlynecessary information.

This invention therefore provides an operation guidance informationreproducing method for reading operation guidance information dependingon an event from a database, reproducing and notifying it to an operatorwhen the event requiring measures taken by the operator occurs in anobject apparatus, comprising the step of reproducing the operationguidance information about measures that should be taken to a conditionof said apparatus changing with a progress of the measures taken by theoperator at a terminal apparatus connected to said object apparatus andmanaging said object apparatus to notify the operation guidanceinformation to the operator.

The present invention also provides an operation guidance informationreproducing apparatus comprising a reproduction control unit for readingoperation guidance information depending on an event from a databasewhen the event requiring measures taken by an operator occurs in anobject apparatus to control reproduction of said operation guidanceinformation, and a reproducing unit controlled by said reproductioncontrol unit for reproducing said operation guidance information tonotify it to the operator, said reproducing unit being a terminalapparatus connected to said object apparatus to be able to manage saidobject apparatus, said operation guidance information about measuresthat should be taken to a condition of said object apparatus changingwith a progress of the measures taken by the operator being reproducedat said terminal apparatus.

According to the above method and apparatus, an operation guidanceinformation about measures that should be next taken to a condition ofan object apparatus changing with a progress of measures taken by anoperator is reproduced at a terminal apparatus, which is connected tothe object apparatus to manage it. The terminal apparatus has a displayunit. The detailed operation guidance information is reproduced at thedisplay unit so that the operator can accurately grasp a procedure ofthe operation. Further, the terminal apparatus is provided in advance tomanage the object apparatus. It is therefore unnecessary to newlyprovide an apparatus served to reproduce the detailed operation guidanceinformation so that the accurate operation procedure may be reproducedat a low cost.

The present invention further provides an operation guidance informationreproducing method for reading operation guidance information dependingon an event from a database, reproducing and notifying it to an operatorwhen the event requiring measures taken by the operator occurs in anobject apparatus, comprising the steps of detecting a condition of saidobject apparatus changing with a progress of measures taken by theoperator, and successively reproducing the operation guidanceinformation about the measures that should be taken to a presentcondition of said object apparatus in linkage with a detected conditionof said object apparatus and notifying it to the operator.

The present invention also provides an operation guidance informationreproducing apparatus comprising a reproduction control unit for readingoperation guidance information depending on an event from a databasewhen the event requiring measures taken by an operator occurs in anobject apparatus to control reproduction of said operation guidanceinformation, and a reproducing unit controlled by said reproductioncontrol unit for reproducing said operation guidance information tonotify it to the operator, said reproduction control unit receiving acondition of said object apparatus changing with a progress of measurestaken by the operator as a result of detection by a sensor in saidobject apparatus, controlling said reproducing unit to successivelyreproduce the operation guidance information about the measures thatshould be taken to a present condition of said object apparatus inlinkage with a condition of said object apparatus.

According to these method and apparatus, an operation guidanceinformation about measures that should be taken to a present conditionof an object apparatus is successively reproduced in linkage with thecondition of the object apparatus changing with a progress of themeasures taken by the operator so that the user can use the operationguidance information automatically without bothering the operatorhimself or herself. This improves the operation efficiency to a greatextent.

The present invention further provides an operation guidance informationreproducing method for reading operation guidance information dependingon an event from a database, reproducing and notifying it to an operatorwhen the event requiring measures taken by the operator occurs in anobject apparatus, comprising the step of reproducing contents in thelowest degree of detail as said operation guidance information, thensuccessively reproducing contents in a gradual higher degree of detailaccording to a request by the operator.

The present invention also provides an operation guidance informationreproducing apparatus comprising a reproduction control unit for readingoperation guidance information depending on an event from a databasewhen the event requiring measures taken by an operator occurs in anobject apparatus to control reproduction of said operation guidanceinformation, a reproducing unit controlled by said reproduction controlunit for reproducing said operation guidance information to notify it tothe operator, and an input unit for instructing to alter a degree ofdetail of the operation guidance information reproduced by saidreproducing unit, said reproduction control unit controlling toreproduce the operation guidance information having contents in thelowest degree of detail at said reproducing unit, and controlling tosuccessively reproduce the operation guidance information havingcontents in a gradually higher degree of detail whenever receiving aninstruction or a request to alter the degree of detail from the operatorthrough said input unit.

According to the above method and apparatus, an operation guidanceinformation having contents from the lowest degree of detail to a higherdegree of detail is successively reproduced in a step-by-step fashionaccording to a user's demand so that the operation guidance meeting alevel of an operator is efficiently provided without forcing aninefficient work to the operator.

The present invention still further provides an operation guidanceinformation reproducing method for reading operation guidanceinformation depending on an event from a database, reproducing andnotifying it to an operator when the event requiring measures taken bythe operator occurs in an object apparatus, comprising the steps ofstoring in advance said operation guidance information in a state ofmeasures information parts obtained by deassembling said operationguidance information into parts each of which is a minimum unit ofmeasures which may be taken to said object apparatus by the operator insaid database, reading the plural measures information parts dependingon said event from said database, determining the order of reproducingsaid plural measures information parts such as to avoid the samemeasures information part from duplicating depending on said event, andsuccessively reproducing said plural measures information parts in saidorder of reproduction, notifying them as the operation guidanceinformation depending on said event to said operator.

The present invention also provides an operation guidance informationreproducing apparatus comprising a reproduction control unit for readingoperation guidance information depending on an event from a databasewhen the event requiring measures taken by an operator occurs in anobject apparatus to control reproduction of said operation guidanceinformation, a reproducing unit controlled by said reproduction controlunit for reproducing said operation guidance information to notify it tothe operator, said operation guidance information in a state of measuresinformation parts obtained by deassembling said operation guidanceinformation into parts each of which is a minimum unit of measures takento said object apparatus by the operator being stored in advance in saiddatabase, a searching unit for searching for plural measures informationparts depending on said event in said database, and an order determiningunit for determining an order of reproducing said plural measuresinformation parts searched by said searching unit such as to avoidduplication of the same measures part, said reproducing control unitsuccessively reproducing said plural measures information parts fromsaid database in the order of reproduction determined by said orderdetermining unit at said reproducing unit.

According to the above method and apparatus, the operation guidanceinformation is deassembled into parts each of which is a minimum unit ofmeasures, thereby producing and reproducing the operation guidanceinformation such as to avoid duplication of the same measuresinformation part. The operation guidance information may therefore bereproduced without a useless operation and repetition of the sameoperation, and measures that should be next taken to an occurring eventin the most efficient order may be notified as the operation guidanceinformation to the operator.

The present invention still further provides a multi-media reproducingmethod for reproducing multi-media information including imageinformation and sound information comprising the steps of storing inadvance said multi-media information in a state of multi-media partsobtained by deassembling said multi-media information into parts each ofwhich is a unit according to contents of the information, formingsequence data made up of key data designating each multi-media part inorder to determine an order of reproducing plural voluntary multi-mediaparts in said database according to an instruction from a user, andreading said plural multi-media data parts from said database accordingto said sequence data produced, successively reproducing them.

The present invention also provides a multi-media informationreproducing apparatus having a display unit for reproducing imageinformation and a sound outputting unit for reproducing soundinformation in order to reproduce multi-media information including theimage information and the sound information, comprising a database forstoring in advance said multi-media information in a state ofmulti-media parts obtained by deassembling said multi-media informationinto parts each of which is a unit according to contents of theinformation, an input unit for inputting necessary instruction toreproduce the multi-media parts in said database, a sequence dataforming means for forming a sequence data made up of key datadesignating each multi-media part in order to determine an order ofreproducing a plural voluntary multi-media data parts in said databaseaccording to an instruction through said input unit, and a sequence datareproducing means for reading said plural multi-media parts from saiddatabase according to the sequence data formed by said sequence dataforming means when receiving an instruction to start reproductionthrough said input unit, successively reproducing said pluralmulti-media data parts at said display unit and said sound outputtingunit.

According to the above multi-media reproducing method and apparatus,when the user voluntarily select multi-media parts formed in advance,each of the selected parts is automatically reproduced in order ofreproduction so that a multi-media title including only a necessaryinformation in a mode meeting a user's demand may be readily formed andreproduced. The user may thereby efficiently watch and listen onlynecessary information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1 through 5 are block diagrams showing aspects of this invention;

FIG. 6 is a block diagram showing a structure of an operation guidanceinformation reproducing apparatus according to a first embodiment ofthis invention;

FIG. 7 is a schematic vertical sectional view showing a structure of anobject apparatus (a bank note depositing/paying apparatus) and anarrangement of sensors according to the first embodiment;

FIG. 8 shows an error code setting screen according to the firstembodiment;

FIG. 9 shows a part setting screen according to the first embodiment;

FIG. 10 shows a part operation order setting screen according to thefirst embodiment;

FIG. 11 shows a relation of part codes among them according to the firstembodiment;

FIG. 12 shows a help data part table according to the first embodiment;

FIG. 13 shows an address converting table according to the firstembodiment;

FIG. 14 is a flowchart illustrating an entire flow of a help informationreproducing process according to the first embodiment;

FIG. 15 is an illustration of an example of a hierarchical screendisplay according to a level of an operator along a flow of an actualprocess according to the first embodiment;

FIGS. 16 through 19 are flowcharts illustrating a procedure of areproducing process for multi-media help information according to thefirst embodiment;

FIG. 20 is a block diagram of an operation guidance informationreproducing apparatus according to a second embodiment of thisinvention;

FIG. 21 is a flowchart illustrating an operation of the secondembodiment;

FIG. 22 is a block diagram showing a structure of a multi-mediainformation reproducing apparatus according to a third embodiment ofthis invention;

FIG. 23 shows a configuration of a multi-media part according to thethird embodiment;

FIG. 24 shows a configuration of a multi-media database according to thethird embodiment;

FIG. 25 shows a configuration of a sequence data file according to thethird embodiment;

FIG. 26 is a flowchart illustrating an operation of the thirdembodiment;

FIGS. 27 through 32 are flowcharts illustrating an operation of thethird embodiment; and

FIGS. 33(a) through 33(k) show actual displays for the purpose ofillustrating an operation of the third embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENT

(A) Description of Aspects of the Invention

FIG. 1 is a block diagram showing an aspect of this invention. In FIG.1, reference numeral 1A denotes a reproduction control unit. Thereproduction control unit 1A reads operation guidance informationdepending on an event from a database 4 and controls reproduction ofthis operation guidance information when the event which needs anymeasures taken by an operator occurs in an object apparatus 3.

Reference numeral 2A denotes a reproducing unit. The reproducing unit 2Areproduces the operation guidance information and notifies it to theoperator under a control of the reproduction control unit 1A. Accordingto this invention, the reproducing unit 2A is a terminal apparatus whichis connected to the object apparatus 3 and is capable of managing it. Atthe terminal apparatus 2A, the operation guidance information aboutmeasures that should be taken to a condition of the object apparatus 3changing with a progress of the measures taken by the operator isreproduced.

In the operation guidance information reproducing method and apparatusof this invention having been described with reference to FIG. 1, theoperation guidance information about measures that should be taken to acondition of the object apparatus 3 changing with a progress of themeasures taken by an operator is reproduced on a display unit of theterminal apparatus (the reproducing unit)) 2A. It is therefore possibleto grasp in detail the operation guidance for the individual objectapparatus 3 through the display unit of the terminal apparatus 2A.

As this, according to the operation guidance information reproducingmethod and apparatus of this invention shown in FIG. 1, detailedoperation guidance information is reproduced on the display unit of theterminal apparatus 2A so that the operator can grasp accurately aprocedure of the operation. The terminal apparatus 2A is installed inadvance for controlling the object apparatus 3. Accordingly, it isunnecessary to newly provide an apparatus for reproducing detailedoperation guidance information so that correct reproduction of theoperation procedure may be realized at a low cost.

FIG. 2 is a block diagram showing another aspect of the invention. InFIG. 2, reference numeral Al denotes a reproduction control unit. Thereproduction control unit 1A reads an operation guidance informationdepending on an event from a database 4 and controls reproduction ofthis operation guidance information when the event which needs anymeasures taken by an operator occurs in an object apparatus 3.

Reference numeral 2 denotes a reproducing unit. The reproducing unit 2reproduces the operation guidance information and notifies it to theoperator under a control of the reproduction control unit 1A.

The reproduction control unit 1A of the invention receives a conditionof the object apparatus 3 changing with a progress of the measures takenby the operator as a result of detection by a sensor 5 in the objectapparatus 3, and controls a reproducing unit 2 to successively reproducethe operation guidance information about the measures which should betaken to a present condition of the object apparatus 3 in linkage with acondition of the object apparatus 3.

In the operation guidance information reproducing method and apparatusof this invention having been described with reference to FIG. 2, thesensor 5 detects a condition of the object apparatus 3 changing with aprogress of the measures taken by the operator, and the reproductioncontrol unit 1A controls the reproducing unit 2 to automatically andsuccessively reproduce the operation guidance information about themeasures that should be taken to a present condition of the objectapparatus 3 on the basis of a result of detection by the sensor 5 inlinkage with a condition of the object apparatus 3.

In consequence, it is unnecessary that the operator gives an instructionevery occasion in order to refer to the next operation guidance. It istherefore possible that the operator can automatically use the operationguidance information without troubling himself or herself. This resultsin a large improvement in the operation efficiency.

FIG. 3 is a block diagram showing still another aspect of thisinvention. In FIG. 3, reference numeral 1B denotes a reproductioncontrol unit having a function similar to that of the reproductioncontrol unit 1A having been described with reference to FIG. 1.Reference numeral 6 denotes an input unit for giving an instruction toalter a degree of detail of the operation guidance informationreproduced by a reproducing unit 2.

The reproduction control unit 1B of this invention reproduces theoperation guidance information having contents in the lowest degree ofdetail, and controls the reproducing unit 2 to successively reproducethe operation guidance information having contents of a higher degree ofdetails step by step every time the operator gives an instruction or arequest to alter the degree of detail through an input unit 6.

In the operation guidance information reproducing method and apparatusof this invention having been described with reference to FIG. 3, thereproduction control unit 1B reproduces first the operation guidanceinformation having contents in the lowest degree of detail at thereproducing unit 2. Each time the operator gives an instruction or arequest to alter the degree of detail through the input unit 6, theoperation guidance information having a higher degree of detail issuccessively reproduced step by step at the reproducing unit 2.

In consequence, it is possible that the operator can use the operationguidance information in a level meeting a level of the operator himselfor herself as descending a hierarchical stage of degrees of detail,while referring to contents of the operation guidance informationdepending on a degree of detail by himself or herself. Namely, thereproduction control unit 2 reproduces the operation guidanceinformation having contents in the lowest degree of detail, thensuccessively reproduces the operation guidance information havingcontents in a higher degree of detail step by step in response to arequest by the operator. It is therefore possible to guide the operationdepending on a level of the operator efficiently without forcing theoperator to do an inefficient work.

FIG. 4 is a block diagram showing still another aspect of thisinvention. In FIG. 4, reference numeral 1C denotes a reproductioncontrol unit having a function similar to that of the reproductioncontrol unit 1A having been described with reference to FIGS. 1 and 2.In a database 4, the operation guidance information is stored in advancein a state of measures information parts obtained by deassembling theoperation guidance information into parts each of which is a minimumunit of measures that can be taken to the object apparatus 3 by theoperator.

Reference numeral 7 denotes a searching unit for searching for pluralmeasures information parts in a database 4 depending on an eventoccurring in the object apparatus 3. Reference numeral 8 denotes anorder determining unit for determining an order of reproducing theplural measures information parts searched by the searching unit 7depending on the event such as to avoid duplication of the same measuresinformation part.

The reproduction control unit 1C of this invention controls thereproducing unit 2 to successively reproduce the plural measuresinformation parts fed from the database 4 in the order of reproductiondetermined by the order determining unit 8.

In the operation guidance information reproducing method and apparatusof this invention having been described with reference to FIG. 4, thesearching unit 7 searches for plural measures information partsdepending on an event occurring in the object apparatus 3 in thedatabase 4, and the reproduction order determining unit 8 determines anorder of reproducing the plural measures informationparts searched bythe searching unit 7 such as to avoid duplication of the same measuresinformation part.

After that, the reproduction control unit 1C successively reproduces theplural measures information parts fed from the database 4 in the orderof reproduction determined by the order determining unit 8 at thereproducing unit 2.

If a plurality of events occur simultaneously in the object apparatus 3,it is possible to notify the operation guidance information depending onthese events to the operator in one reproduction without repeating thesame operation. For this, useless operation may be omitted.

According to the operation guidance information reproducing method andapparatus of this invention shown in FIG. 4, it is possible to form andreproduce the operation guidance information such as to avoidduplication of the same measures information part by deassembling theoperation guidance information into parts each of which is a minimumunit of the measures. It is therefore possible to notify the operationguidance information to treat the occurring events in the most efficientorder, thereby omitting useless operation and avoiding repetition of thesame operation.

The reproducing unit 2 may be configured with a display unit forreproducing and displaying the operation guidance information as animage. It is also possible to reproduce and display the operationguidance information on the display unit as an image of an actualprocedure of the operation visualized from a viewpoint of the operatorlooking at the object apparatus 3.

In the above case, contents of the operation can be notified to theoperator quite comprehensively so that the operator can grasp theprocedure of the operation visually.

It is also possible to reproduce and display the operation guidanceinformation as character information explaining an actual procedure ofthe operation on the display unit along with the image. The apparatus ofthis invention may further includes a sound outputting unit as thereproducing unit 2 for reproducing and outputting the operation guidanceinformation as a sound, thereby reproducing and outputting soundinformation explaining an actual procedure of the operation from thesound outputting unit in simultaneous with a reproduction and a displayof the image on the display unit. As a result, it is possible that amulti-media function can be used effectively, the operator can grasp theprocedure of the operation more certainly thereby.

It is also possible to reproduce the operation guidance information inthe terminal apparatus connected to the object apparatus 3, which canmanage the object apparatus 3. It is also possible that the database 4is commonly used by another apparatus provided on the side of an upperapparatus. In this case, a function of the operation guidanceinformation reproducing apparatus of this invention can be realized inthe terminal apparatus managing the object apparatus 3. The database 4is installed on the side of the upper apparatus and commonly used byanother apparatus, whereby the database 4 (a system source) can be usedeffectively. Accordingly, the function as the operation guidanceinformation reproducing apparatus of this invention may be readilyrealized without another apparatus separately provided. The database isprovided on the side of the upper apparatus and used commonly by anotherterminal apparatus (the operation guidance information reproducingapparatus) so that the system source may be effectively utilized.

FIG. 5 is a block diagram of still another aspect of this invention. InFIG. 5, reference numerals 11 and 12 denote a display unit forreproducing image information and a sound outputting unit forreproducing sound information, both of which are used for reproducingmulti-media information including the image information and the soundinformation, respectively.

Reference numeral 13 denotes a database, 14 denotes an input unit, 15denotes a sequence data forming means, and 16 denotes a sequence datareproducing means.

The database 13 serves to store multi-media information in advance in astate of multi-media data parts obtained by deassembling the multi-mediainformation into parts each of which is a minimum unit according tocontents of the information. The input unit 14 is used to input aninstruction necessary to reproduce the multi-media data parts in thedatabase 13.

The sequence data forming means 15 forms a sequence data made up of keydata designating each of the multi-media parts for the purpose ofdetermining an order of reproducing plural voluntary multi-media partsin the database 13 according to an instruction through the input unit14.

The sequence data reproducing means 16 reads plural multi-media dataparts according to a sequence data formed by the sequence data formingmeans 15 when receiving an instruction to start a reproduction throughthe input unit 14, and successively reproduce the plural multi-mediadata parts at the display unit 11 and the sound output unit 12.

It is possible that the sequence data forming means 15 reproducesinformation necessary to form a sequence data at the display unit 11 andthe sound outputting unit 12, and forms a sequence data by receiving aninput of an instruction from the user who is referring to thisinformation through the input unit 14.

Each of the multi-media parts may be configured with unique key data ofeach multi-media data part, image data for one scene and sound data forone scene, and control data for the image data and the sound data.

In the multi-media information reproducing method and apparatus of thisinvention having been described with reference to FIG. 5, the sequencedata forming means 15 forms a sequence data configured with key datadesignating multi-media parts according to an instruction through theinput unit 14, and determines an order of reproducing plural voluntarymulti-media parts in the database 13.

When receiving an instruction to start a reproduction through the inputunit 14, the sequence data reproducing means 16 reads plural multi-mediadata parts from the database 13 according to a sequence data formed bythe sequence data producing means 15, and successively reproduces theplural multi-media parts at the display unit 11 and the sound outputtingunit 12.

In consequence, when the user voluntarily selects the multi-media dataparts formed previously, each of the selected parts is automaticallyreproduced in the order of reproduction of the parts (sequence data) sothat it is possible for the user to readily form a multi-media titleconfigured with only desiring information in a mode of reproductionmeeting a user's demand and reproduce it.

The sequence data forming means 15 reproduces information necessary toform a sequence data at the display unit 11 and the sound outputtingunit 12. The user inputs an instruction through the input unit 14 byreferring to that information to proceed a formation of sequence data inan interactive mode. It is therefore possible for a user who knowsnothing about a manner to form the sequence data to readily form amulti-media title.

The multi-media data part may be configured with key data, image dataand sound data each for one scene, and control data for these data sothat it is possible to select one part for each scene to 3 configure amulti-media title. It is also possible to apply a special effect to theimage data and the sound data by virtue of the control data when theyare reproduced.

As above, according to the multi-media information reproducing methodand apparatus of this invention shown in FIG. 5, when the uservoluntarily selects the multi-media data parts previously produced,selected parts are automatically reproduced in an order of reproductionof the parts so that it is possible to readily form and reproduce amulti-media title including only desiring information in a mode ofreproduction meeting a user's demand. The user can effectively watch andlisten only necessary information.

By forming the sequence data in the interaction with the user, the userwho knows nothing about a manner to form can readily form a multi-mediatitle and use effectively only necessary information.

One part is selected for only one scene. This allows an easy formationof a multi-media title having plural scenes. In addition to this, it ispossible to apply a special effect by virtue of the control data wheneach part is reproduced.

(B) Description of First Embodiment

Hereinafter, description will be made of an embodiment of this inventionreferring to the drawings.

FIG. 6 is a block diagram showing a structure of an operation guidanceinformation reproducing apparatus as a first embodiment of thisinvention. In FIG. 6, reference numeral 20 denotes a bank notedepositing/paying apparatus (a business apparatus, a peripheralequipment, an object apparatus) having a structure described later withreference to FIG. 7. When an event (referred collectively as an error,hereinafter) requiring any measures taken by an operator such as anerror or a necessity of medium supply occurs in the bank notedepositing/paying apparatus 20, the apparatus according to thisembodiment senses a type of the error, automatically reproduces anddisplays a procedure of an operation for recovering the present error.

The bank note depositing/paying apparatus 20 is used for a service atthe window in a bank or the like to deposit or pay bank notes exchangedin a transaction between an operator at the transaction window and acustomer. The bank note depositing/paying apparatus 20 is, in general,disposed in the vicinity of the operator at the transaction window forthe customer, and is connected to a terminal apparatus through which theoperator inputs data. Via this terminal apparatus, the bank notedepositing/paying apparatus 20 is managed its operational condition. Afunction of an operation guide information reproducing apparatusaccording to this embodiment described later is provided in, forexample, the above-stated terminal apparatus.

The bank note depositing/paying apparatus 20 is configured, for example,as shown in FIG. 7.

In FIG. 7, reference numeral 21 denotes a note inlet into which banknotes are throw, 22 denotes a discriminating unit for discriminating thenotes thrown in through the note inlet 21, 23 denotes a turning overunit for turning over the note, 24A through 24c denote temporarilyholding units for temporarily holding the deposited notes, 25 denotes areject separately conveying path for shunting an inappropriate note froma normal conveying path to discharge it, and 26 denotes a rejectdischarge opening for discharging the inappropriate note shunt by thereject separately conveying path 25.

Reference numeral 27 denotes a note cassette for storing and holdingnotes, 28 and 29 denote a first stacker and a second stacker,respectively, for storing and holding the notes, 30 denotes a lowerconveying unit for paying notes from the note cassette 27, stacker 28 or29, 31 denotes a paid note discriminating unit for discriminating notesfed from the note cassette 27, the stacker 28 or 29, 32 denotes a noteoutlet through which paid notes are discharged, and 33 denotes a rejectbox for taking inappropriate notes therein.

In order to convey the notes within the bank note depositing/payingapparatus 20, a number of rollers (no reference characters are attached)along the note conveying path, as shown in FIG. 7. These rollers arerotatably driven by a driving motor 35. The driving motor 35 receives anelectric power supply from a power source unit 34 to operate.

In such a mechanism (a mechanism 20A in FIG. 6), optical sensors 20B aredisposed in certain spots in the mechanism 20A to detect a jam of thenote on the conveying path, a volume of the notes in the note cassette27, the stackers 28 and 29, or presence or absence of the notes withinthe reject box 33. In addition to these, mechanical sensors 20c (referto FIG. 6), not shown in FIG. 7, are disposed in certain spots to detecta condition of open or close of a door in front of the bank notedepositing/paying apparatus 20, or a condition of installation ofvarious mechanisms such as a mechanism housing chamber in the bank notedepositing/paying apparatus 20 (referred mechanisms, hereinafter)against the bank note depositing/paying apparatus 20 itself.

As shown in FIG. 6, the bank note depositing/paying apparatus 20 has amechanism operation control unit 20D for controlling a condition ofoperation of the mechanism 20A in the bank note depositing/payingapparatus 20, a sensor control unit 20E for grasping and supervising acondition of the mechanism 20A (such as an occurrence of an error)through the sensors 20B and 20C, an error information storing unit 20Gand a bank note depositing/paying apparatus control unit 20F.

The error information storing unit 20G stores error codes (errorinformation) of errors generating in the mechanism 20A beforehand. Thebank note depositing/paying apparatus control unit 20F makes a search inthe error information storing unit 20G on the basis of informationhaving been collected by the sensor control unit 20E, and notifies acorresponding error code to a multi-media help control unit 47.

A structure of an apparatus according to this embodiment for reproducingoperation guide information (help information) in terms of the bank notedepositing/paying apparatus 20 above-mentioned will be next describedreferring to FIG. 6. In FIG. 6, reference numeral 40 denotes an inputunit by which an operator inputs various information. The input unit 40has a keyboard 40A, a mouse 40B and an input control unit 40C formanaging a condition of inputs through the keyboard 40A or the mouse40B.

Reference numeral 41 denotes a user interface control unit for receivinga signal from the input unit 40 (the input control unit 40C) andtransferring the signal to a multi-media help control unit 47 or anerror information record control unit 44, both described later.Reference numeral 42 denotes a reproducing unit reproduces multi-mediainformation including image information and sound information. Thereproducing unit 42 has a CRT (a display unit) 42A for reproducing theimage information, a speaker (a sound outputting unit) 42B forreproducing the sound information, and a multi-media informationdisplay-output control unit 42C for controlling actual states ofreproduction of the image information and the sound information at theCRT 42A and the speaker 42B.

Reference numeral 43 denotes a multi-media database. In the multi-mediadatabase 43 according to this embodiment, various operation guidanceinformation in terms of the bank note depositing/paying apparatus 20 isstored in advance as multi-media information including the imageinformation and the sound information.

Not only when an error (jam of note, short of note, etc.) requiring anymeasures taken by the operator in the bank note depositing/payingapparatus 20 occurs, but also when the operator needs an operationguidance with or without an error, the operation guidance information isreproduced as described later and notified to the operator.

In the multi-media database 43, the multi-media information in terms ofthe operation guidance information is stored in a state of multi-mediahelp data parts (measures information parts; referred as simply parts,hereinafter) each of which is a minimum unit of measures taken by theoperator to the bank note depositing/paying apparatus 20, as will bedescribed later with reference to Table 2 or FIG. 11.

Each part includes the image information which is a visualized actualoperational procedure from a viewpoint of the operator looking at thebank note depositing/paying apparatus 20, character information forillustrating the actual operational procedure (this may be included inthe image information) and the sound information for illustrating theactual operational procedure.

Reference numeral 44 denotes an error information record control unit,45 denotes an error information storing unit, 46 denotes a multi-mediainformation search control unit (a searching unit), 47 denotes amulti-media help control unit (a reproduction control unit, an orderdeciding unit) and 48 denotes a storage for flags.

The error information record control unit 44 has a function to record anerror record of each error occurring in the bank note depositing/payingapparatus 20, and a function to record and edit information about partspart codes which designate parts (key data)! indispensable forconstituting the help information used to cope with an error for eacherror code.

The error information record control unit 44, in association with themulti-media help control unit 46, has a function to record and edit apart code for each of various errors, a function to rearrange the partcodes having been recorded and edited in order of operation and afunction to allocate a sequence of the part codes to each error code. Astate of the error information record by these means is displayed on theCRT 42A, for example, as will be described with reference to FIGS. 8through 10, to be provided to the operator. The operator operates thekeyboard 40A or the mouse 40B while referring the display to inputdesiring information, thereby recording and editing the errorinformation in an interactive mode.

The information edited by the error information record control unit 44is stored and retained in the error information storing unit 45 for eacherror code as, for example, a table shown in Table 1. In the errorstoring unit 45, only part codes for designating a part are recorded.Actual image information or sound information are not recorded in theerror information storing unit 45.

The multi-media information search control unit 46 searches for parts inthe multi-media database 43 according to an instruction from themulti-media help control unit 47 and information from the errorinformation storing unit 45, as described later.

The multi-media help control unit 47 operates according to a flowchart,which will be described later with reference to FIGS. 14, 16 through 19,to function characteristically as this invention. The multi-media helpcontrol unit 47, in association with the mechanism operation controlunit 20D, the sensor control unit 20E, the error information recordcontrol unit 44 and the multi-media information search control unit 46,controls to reproduce the multi-media information to display and outputit.

More specifically, the multi-media control unit 47 detects an occurrenceof an error at the mechanism 20A in the bank note depositing/payingapparatus 20 through the sensor control unit 20E. When receiving theoccurrence of error from the sensor control unit 20E, the multi-mediacontrol unit 47 causes the error information record control unit 44 tosearch into the error information storing unit 45, takes out errorinformation (refer to Table 1) according to an error code of the erroroccurring this time, causes the multi-media information search controlunit 46 to search into the multi-media database 43 according to theerror information (a sequence of part codes), and reproduces parts (themulti-media information) read out in order of reproduction decided onthe basis of a sequence or the like of the part codes under its control.

A timing to reproduce, display and output the multi-media information ofeach part is determined in association with the sensor control unit 20E.In linkage with a state of the mechanism 20A, the multi-mediainformation of each part is reproduced. Depending on a condition ofrecord of the error information, a reset operation on the mechanism isperformed through the mechanism operation control unit 20D.

Now, detailed description of functions of the multi-media help controlunit 47 of this embodiment will be made. The multi-media control unit 47has mainly three functions as below:

As a first function, the multi-media help control unit 47 receives acondition of the mechanism 20A changing with a progress of measurestaken by the operator through the sensors 20B and 20C and the sensorcontrol unit 20E, and causes the reproducing unit 42 to sequentiallyreproduce the help information in terms of measures that should be takento a present condition of the mechanism 20A in linkage with a conditionof the mechanism 20A, as stated before.

As a second function, the multi-media help control unit 47 controls toreproduce operation guidance information having contents in the lowestdegree of detail (help information for seniors) at the reproducing unit42, and controls to successively reproduce operation guidanceinformation in a gradual higher degree of detail (help information foroperators in the middle level, help information for beginners) at thereproducing unit 42 controllably whenever the operator directs orrequests alteration of a degree of detail through the input unit 40.

As a third function, when a plurality of errors occur simultaneously inthe mechanism 20A, the multi-media help control unit 47 sorts all partcodes corresponding all the errors searched in the error informationstoring unit 45 by the error information record control unit 44. Ifthere are the same part codes, the multi-media help control unit 47 addsone of these same part codes to the order (a sequence) of reproductionof the help information such as to prevent the same part fromduplicating in order of reproduction of the parts. The multi-mediacontrol unit 47 controls the reproducing unit 42 to successivelyreproduce the parts obtained by a search into the database 43 by themulti-media information search control unit 46 in the determined orderof reproduction.

The storage 48 for flags stores various flags therein set upon a controloperation by the multi-media help control unit 47. In practice, a partflag used for clearly indicate a part in which a treatment to themechanism 20A has been finished and a displaying-reproducing process hasbeen completed or the like is set and retained in the storage 48, aswill be described later with reference to FIGS. 18 and 19.

An operation of the operation guidance information reproducing apparatusof this embodiment having the above structure will be next describedwith reference to FIGS. 18 and 19.

First, the third function of the above-mentioned multi-media helpcontrol unit 47 (that is, a function to combine parts withoutduplicating the same work to enable an operation guidance in the mostefficient order if a plurality of errors occur simultaneously) will bedescribed by way of a practical example.

Incidentally, under a condition of a screen display described infollowing items (a1) through (a3) among the items (a1) through (a4), themulti-media help control unit 47 and the error information recordcontrol unit 44 operate in association according to a request (an inputof an instruction through the input unit 40) from the user (theoperator) so that a result of the error information record is stored inthe error information storing unit 45 through the error record controlunit 44.

(a1) The user (the operator) records all error events recoverable byhimself or herself for each type of errors. On this occasion, each typeof errors are labeled a unique error code. An example of display of anerror code setting screen on the CRT 42A is shown in FIG. 8. On thescreen shown in FIG. 8, a unique error code "00003" is set to, forexample, a type of error "note jam occurring in mechanism γ" (a note jamoccurring in the mechanism γ constituting the mechanism 20A), asindicated by a shaded portion. In this stage, no part structure for thistype of error is not yet recorded.

(a2) A flow of an operation to treat an error corresponding to eacherror code is divided into units on the time axis as small as possibleand stored as parts. A type and a condition of a sensor that becomes aterminating condition of the part are stored at the same time. FIG. 9shows an example of display of a part setting screen on the CRT 42A atthat time. In the screen in FIG. 9, contents of a part A that is "opendoor A" is displayed besides a setting condition of a conditionnecessary to terminate a reproduction of that part (that is, the door Asensor becomes an open state, here). In a part setting screen in FIG. 9,regions of "newly store", "alter", "delete", "search for the contents"and "sensor search" are display in order to confirm and edit thecontents of each part. Various operations are performed by clicking amouse pointer in each region.

(a3) For each part recorded on the part setting screen in FIG. 9, anexamination is made as to which order is most efficient and mosteffective to cope with the error to determine an ideal order of theimplementation. The determined order of implementation is recordedthrough a part operation order setting screen. FIG. 10 shows an exampleof a display of the part operation order setting screen on the CRT 42A.On the screen in FIG. 10, a part number is automatically added andaltered whenever each part is rearranged in order of operation.

(a4) When the setting of the order of operation, that is, the order ofreproducing parts, through the part operation order setting screen shownin FIG. 10 is completed, the screen is automatically changed to an errorcode setting screen, as shown in FIG. 8. Under such a display condition,a part structure corresponding to each error code is inputted. An inputof the part structure is performed by selecting a list box (on a windowdisplay) for "part selection" by which the user can see a list of theparts. If there is a common operation among different error codes, itis, of course, possible that the part is commonly used.

Meanwhile, it is possible to install in advance the above error codes,not by the operator such as a bank clerk, to save labour for recordingthe error codes by the operator.

Through a procedure described in the above items (a1) through (a4), apractical example of an procedure until an error code is labelled to anerror event will be described below.

Assuming here that an error event is "occurrence of a note jam in themechanism α" (that is, a note jam occurring in the mechanism α of themechanism 20A).

error code: 00001

type of error: "a note jam in mechanism α"

type of part:

(1) "open door A": open the door A in front of the apparatus;

(2) "open mechanism housing chamber B": draw the mechanism housingchamber B from the body;

(3) "remove the jam from mechanism α": remove the note jam from themechanism α above the mechanism housing chamber B;

(4) "close mechanism housing chamber B": push the mechanism housingchamber B into the body to set it;

(5) "close door A": close the door A; terminating condition of eachpart:

(1) door A sensor: open

(2) mechanism housing chamber B sensor: open

(3) mechanism α sensor: normal

(4) mechanism housing chamber B sensor: close

(5) door A sensor: close

Assumed here, as an instance, that there are seven error events in all,and these errors are categorized as below. Table 1 shows priority `a`through `c` corresponding to each error code, types of error, partsindispensable for error recovery and sequences. Table 2 shows detailedcontents of operations of part codes used in error codes 00001 and00002. FIG. 11 shows an example of a relation among the part codes Athrough X.

                  TABLE 1                                                         ______________________________________                                        error                      parts necessary for error                          code   priority type of error                                                                            recovery and sequence                              ______________________________________                                        00001  a (priority;                                                                           mechanism α                                                                        A -> B -> C -> E -> I                                     large)   note jam                                                      00002  a (priority;                                                                           mechanism β                                                                         A -> B -> D -> E -> I                                     large)   note jam                                                      00003  a (priority;                                                                           mechanism γ                                                                        A -> G -> H -> I -> J                                     large    note jam                                                      01001  b (priority;                                                                           medium     K -> L -> M -> N -> R                                     middle   supplement                                                                    (1 million                                                                    note)                                                         01002  b (priority;                                                                           medium     K -> O -> P -> Q -> R                                     middle   supplement                                                                    (1 thousand                                                                   note)                                                         02001  c (priority;                                                                           time to    S -> T -> U -> V -> X -> Y                                small    clean the                                                                     note inlet                                                    02002  c (priority;                                                                           time to    S -> T -> W -> X -> Y                                     small    clean the                                                                     note outlet                                                   ______________________________________                                    

                  TABLE 2                                                         ______________________________________                                        part                                                                          code   detail                                                                 ______________________________________                                        A      open the door A in front of the apparatus                              B      draw out the mechanism housing chamber B from the body                 C      remove a note jam from the mechanism α above the                        mechanism housing chamber B                                            D      draw out the mechanism β from the mechanism                              housing chamber B, remove the note jam, push the                              mechanism into the mechanism housing chamber B to set it               E      push the mechanism housing chamber B into a body                              to set it                                                              I      close the door A                                                       ______________________________________                                    

For each of the part determined in the above procedure, the multi-mediahelp information is formed. The multi-media help information issuccessively reproduced, the image information is displayed on the CRT42A and the sound information is outputted from the speaker 42B, therebynotifying the operation guidance information to the operator so as torecover an error occurring in the mechanism 20A in the bank notedepositing/paying apparatus 20.

In FIG. 11, the part codes used for the error codes 00001 and 00002include A, B, E and I commonly. Differences are only C and D. If the twoerrors occur simultaneously, it is desirable that operations of C and Dare performed after operations of the part codes A and B, after that,operations of E and I are performed. According to this manner, it isunnecessary to repeat the operations A, B, E and I which are commonoperations so that the work becomes more effective. From this viewpoint,a priority of the part code for each of the error code is determined.

Data of image, sound or the like of the multi-media help information isstored in a large capacity storage apparatus (the database 43) such as aCD-ROM, a hard disk, etc. All the part codes of the multi-media helpdata corresponding to the error codes are stored in, for example, a helpdata part table, as shown in FIG. 12, in the error information storingunit 45. Incidentally, each of the help data part tables is in avariable length. At the head of the help data part table, TOD (Top OfData) which is a key when the error information record control unit 44searches for a position of each of the tables is attached. An address atwhich each of the help data parts exists is stored in an addressconverting table, for example, shown in FIG. 13, in the errorinformation storing unit 45.

If errors of the error codes 00001 and 00002 occur simultaneously, themulti-media help control unit 47 searches for the data part table of theboth error codes in the error information storing unit 45 through theerror information record control unit 44, and checks necessary partcodes.

The multi-media help control unit 47 sorts all part codes of the botherror codes. If there are plural same part codes, only one is added tostructural elements of the help information. Here, A, B, E and I whichare common part codes between the both errors fall under it. Therefore,a part code sequence after the sort is "A→B→C→D→E→I".

The multi-media help control unit 47 searches for parts in themulti-media database 43 through the multi-media information searchcontrol unit 46 according to the order of reproduction while referringto the address of each part code in the address converting table in theerror information storing unit 45, and controls to reproduce each partsearched. As this, an error recovering operation guidance is reproduced,displayed and outputted by means of the multi-media. The operator takesmeasures to the mechanism 20A of the bank note depositing/payingapparatus 20 according to the operation guidance so that the error maybe coped with most efficiently.

An entire flow of a help information reproducing process by theapparatus of this embodiment will be next described with reference toFIG. 14 (Steps S1 through S8). In a business machine such as a bank notedepositing/paying apparatus 20 made use at the window of the bank, abusiness screen is displayed on a display of the machine or a display ofa terminal connected to the business machine (CRT 42A in thisembodiment), in general.

As stated before, the bank note depositing/paying apparatus 20 has anumber of optical and mechanical sensors 20B and 20C. On the basis ofdetecting signals fed from these sensors 20B and 20C, when the sensorcontrol unit 20E detects an occurrence of an error in the mechanism 20Aof the bank note depositing/paying apparatus 20 (YES judgement at StepS1), a mechanical operation of the bank note depositing/paying apparatus20 is forced to stop (Step S2).

After that, error information such as a place where the error occurs, anerror code, a condition of the mechanism 20A of the bank notedepositing/paying apparatus 20, etc. is collected through the sensorcontrol unit 20E. When the collected information is notified to the banknote depositing/paying apparatus control unit 20F, the bank notedepositing/paying apparatus control unit 20F searches into the errorinformation storing unit 20G on the basis of the collected information,and notifies a corresponding error code to the multi-media help controlunit 47 (Step S3). If a plurality of errors occur simultaneously,information about these plural errors is collected, and a plural errorcodes are searched and notified. The multi-media help control unit 47searches for the data part table of each of the error code in the errorinformation storing unit 45 through the error information record controlunit 44 on the basis of the notified error codes, and searches for andcollects necessary part codes (Step S4).

The multi-media help control unit 47 sorts all the part codes collected(Step S5), unifies the included plural same part codes into one, andmake a part code sequence (an order of part reproduction) (Step S6).

The multi-media help control unit 47 deduces an address on the database43 in which necessary help data parts are stored on the basis of theunified part code sequence from the address converting table in theerror information storing unit 45, searches for corresponding help dataparts into the database 43 through the multi-media information searchcontrol unit 46, reproduces and displays the image information of thehelp information on the CRT 42A, and, at the same time, reproduces andoutputs the sound information of the help information from the speaker42B (Steps S7 and S8).

Next, a description will be made of a procedure of a process to realizethe above-described first function (a function to reproduce the helpinformation in linkage with a condition of the mechanism 20A) and thesecond function (a function to readily reproduce the help informationdepending on a level of the operator) of the multi-media help controlunit 47 with reference to FIG. 15 and a flowchart shown in FIGS. 16through 19 (Steps S11 through S50).

FIGS. 16 through 19 show a procedure of a control process carried out bythe multi-media control unit 47 when errors of the error codes 00001 and00002 occur simultaneously. In particular, FIG. 15 illustrates examplesof hierarchical screen displayed depending on a level of the operatoralong a practical flow of the process.

When an error occurs in the mechanism 20A in the bank notedepositing/paying apparatus 20, a part flag in the storage 48 for flagis cleared (Step S11 in FIG. 16). As shown in FIG. 15, a help screen Ais displayed from a business screen A0 on the CRT 42A (Step S12). Onthis screen A, a place of the occurrence of the error, an error code anddetailed information are displayed. No multi-media help title is usedhere.

If the operator is in the senior level accustomed to coping with errorsin the bank note depositing/paying apparatus 20, the operator can copewith the error appropriately only by a look at this help screen A, andrecover the bank note depositing/paying apparatus 20. When the recoveryis completed, the sensors 20B and 20C in the mechanism 20A detect therecovery (YES judgement at Step S13 in FIG. 16). Then, an expressionsuch as "recovered" or the like is displayed on the screen (Step S49 inFIG. 19), and the display on the CRT 42A automatically returns to thebusiness screen A0 (Step S50).

If the operator cannot cope with the error only by the help screen A,the operator clicks a display of "detailed explanation" on the CRT 42Athrough the mouse 40B or presses a detailed explanation button on thekeyboard 40A (YES judgement at Step S14 in FIG. 16). In response to thisoperation, a part flag in the storage 48 is checked (Step S15), a screenof a part to which a flag is set is subjected to a special displayprocess such as a gray-colored display or the like (Step S16), and ahelp screen B is displayed (Step S17).

Meanings of processes at Steps S15 and S16 will be described later.According to this embodiment, the help screen A is displayed in theevent of an occurrence of an error, and a timer is simultaneouslyactivated. If the timer detects that a condition where no recovery froma trouble or no request for "detailed explanation" is performedcontinues for a predetermined period or more, the processes at Steps S15and S16 are automatically performed, then the help screen B is displayedat Step S17.

On the help screen B, illustrations (images) and texts (characterinformation) showing a flow of a sequential work for recovering thepresent error are displayed, divided into plural small screens B1through B6 in a lattice arrangement corresponding to respective workunits (parts), displayed from the top left-hand toward the bottomright-hand in order of operation. an order of the display is determinedaccording to the part code sequence having been determined as in theabove manner in order to cope with the error most efficiently.

Each of the screens B1 through B6 is the same as the heading screen ofeach part constituting the multi-media help title. If the operator is ina middle level who is accustomed to coping with errors in the bank notedepositing/paying apparatus 20, the operator can appropriately cope withthe error only by a look at this help screen B, and recover a conditionof the bank note depositing/paying apparatus 20. When the recovery iscompleted, the sensors 20B and 20C in the mechanism 20A detect therecovery (YES judgement at Step S18). An expression such as "recovered"is displayed on the screen (Step S49 in FIG. 19), then the display onthe CRT 42A automatically return to the business screen A0 (Step S50).

If the operator cannot cope with the error only by referring to the helpscreen B, the operator selects a display screen of an operation that theoperator does not know a manner of the operation by clicking through themouse 40B on the CRT 42A (Step S19 in FIG. 16). This operation allowsreproduction of each part of the multi-media help information.

The timer is activated at the same time the help screen B is displayed.If a condition where no recovery from the trouble and no selection ofthe small screens B1 through B6 is continued for a predetermined periodor more (NO judgement at Steps S18 and S19), the procedure proceeds to aprocess to display the help screen at Step S20 in FIG. 17.

As shown in FIG. 15, if the part A (the help screen B1) is clicked, orif the timer detects an elapse of the predetemined period after thedisplay of the help screen B, the procedure proceeds to Step S20 in FIG.17, where more detailed help screens C1-1 through C1-n are successivelydisplayed. Similarly, if the part B, C, D, E or I (any one of the helpscreens B2 through B6) is clicked, the procedure proceeds to Step S24 inFIG. 17, Step S28 in FIG. 18, Step 32 (S35) in FIG. 18, Step S41 in FIG.19, or Step 45 in FIG. 19, where more detailed help screens C2-1 toC2-n; . . . ; and C6-1 to C6-n are successively displayed. These helpscreens C1-1 to C1-n; . . . ; and C6-1 to C6-n are collectively termedas a help screen C.

In this help screen C, an explanation of a manner to recover the errorwith dynamic images, static images, sounds, texts (characterinformation), etc. If the operator is in a beginner level who touchesthe bank note depositing/paying apparatus 20 for the first time, theoperator can appropriately and certainly cope with the error to recoverthe bank note depositing/paying apparatus 20 so long as the operatoroperates the bank note depositing/paying apparatus 20 while referring tothe help screen C.

The dynamic images and static images displayed on the help screen C area visualized procedure of an actual operation from a viewpoint of theoperator looking at the bank note depositing/paying apparatus 20. Thesedynamic images and static images are displayed along with the characterinformation (a text) illustrating an actual procedure of the operation.In simultaneous with a display of these, sounds are also outputted fromthe speaker 42B to explain the actual procedure of the operation.

The help screen C as above is successively changed to a screen showingan operation that should be performed next, while the multi-media helpcontrol unit 47 judges whether the operator has actually taken themeasures on the basis of a result of detection (a condition of themechanism 20A) by the sensors 20B and 20C in the mechanism 20A.

For instance, if the help screen B1 is selected (or, if a predeterminedperiod has been elapsed after a display of the help screen B), the partA in the head of the part code sequence is reproduced, and the helpscreen C1-1 is displayed. The part A is the help information promptingan operation to open the door A in front of the apparatus. As shown inFIG. 15, actual image of each operation is successively displayed ashelp screens C1-1, C1-2 . . . along with character display (soundoutputs) such as "prepare a green key", "insert the key" etc. (Step S20in FIG. 17).

After the display of the part A, if the operator does not click twicethe mouse 40B or press a predetermined key on the keyboard 40A (NOjudgement at Step S21; detailed description of this operation will bemade later), the procedure proceeds to the help display next to the partA. At that time, it is necessary to confirm that the door A is open. So,a detection signal from a door A sensor attached to the door A ischecked to confirm the the door A is open (YES judgement at Step S22),then the next help display is performed.

More specifically, the operator opens the door A by referring to thehelp screen C1-1, C1-2, . . . When the door A sensor detects an opencondition, a flag representing that a process in the part A is completedis set at NO in the storage 48 (Step S23), and a part B that is the nexthelp information is reproduced (Step S24).

As above, once the operator selects the help screen C, the following Cscreens (each of the help data parts) are automatically reproduced anddisplayed at a reproducing timing that is automatically determined inlinkage with the detection signals (a condition of the mechanism 20A)from the sensors 20B and 20C so long as the operator does not give anexpression of interruption.

If the operator wants to interrupt the reproduction and display of thehelp screen C, the operator, for example, clicks the mouse 40B twice orpresses a predetermined key on the keyboard 40A (YES judgement at StepsS21, S25 in FIG. 17, Steps S29, S33, S36 in FIG. 18, S42 or S46 in FIG.19), a procedure returns to the help screen B at Step S17 where theprocedure gets into a wait state for an input, after the processes atSteps S15 and S16 have been performed.

After that, a timing for reproduction of the help data parts isautomatically determined in linkage with a result of detection (acondition of the mechanism 20A) by the sensors 20B and 20C, in thesimilar manner.

If the process in the part A is completed, or if the operator selectsthe help screen B2, the part B is reproduced, and the help screen C2-1is displayed. The part B is help information prompting an operation todraw out the mechanism housing chamber B. So, actual images ofoperations are successively displayed as the help screens C2-1, C2-2, .. . along with character displays (sound outputs) such as "whilepressing a release button . . . ", "pull a release lever", etc., asshown in FIG. 15 (Step S24).

After the display of the part B, if the operator does not click twicethe mouse 40B or press a predetemined key on the keyboard 40A (NOjudgement at Step S25), the procedure proceeds to the next help displayof the part B. At that time, it is necessary to confirm that themechanism housing chamber B has been drawn out. So, the detection signalfrom a mechanism housing chamber B sensor attached to the mechanismhousing chamber B is checked to confirm that the mechanism housingchamber B has been drawn out (YES judgement at Step S26), then the nexthelp is displayed.

More specifically, when the operator draws out the mechanism housingchamber B by referring to the help screens C2-1, C2-2, . . . and themechanism housing chamber B sensor detects an open condition, a flagrepresenting that the process of the part B has been completed is set atON in the storage 48 (Step S27 in FIG. 18), then the part C that is thenext help information is reproduced (Step S28).

When the process of the part B has been completed or if the operatorselects the help screen B3, the part C is reproduced and the helpscreens C3-1, C3-2, . . . are successively displayed (Step S28), wherethe operator is prompted an operation to remove a note jam from themechanism α above the mechanism housing chamber B as help information.

After the display of the part C, if the operator does not click twicethe mouse 40B or press a predetermined key on the keyboard 40A (NOjudgement at Step S29), the procedure proceeds to the next help displayof the part C. At that time, it is necessary to confirm that the notejam has been removed. So, a detection signal from a mechanism α sensorattached to the mechanism α is checked to confirm that the note jam hasbeen removed (YES judgement at Step S30), then the next help isdisplayed.

More specifically, when the operator removes the note jam from themechanism α by referring to the help screens C3-1, C3-2, . . . and themechanism a sensor detects "removal of jam", a flag representing thatthe process of the part C has been completed is set at ON in the storage48 (Step S31), then reproduction of the part D that is the next helpinformation is performed (Step S32).

According to this embodiment, in the part D, three operations that are"draw out the mechanism β from the mechanism housing chamber B, remove anote jam, and push the mechanism β into the mechanism housing chamber Bto set it" are dealt as one part. A meaning of this is that it isnecessary to perform these three operations successively, and there isno meaning if this part is divided into different parts. For the sake ofeasy understanding of the operation, contents of help data of the part Dis divided into two parts D-1 and D-2 in this embodiment.

Accordingly, if the process of the part C has been completed or when theoperator selects the help screen B4, the part D-1 is first reproduced(Step S32), where the operator is prompted an operation to draw themechanism β from the mechanism housing chamber B as help information.

After the display of the part D-1, if the operator does not click twicethe mouse 40B or press a predetermined key on the keyboard 40A (NOjudgement at Step S33), the procedure proceeds to the next help displayof a part D-2. At that time, it is necessary to confirm that themechanism β has been drawn out. So, a detection signal from a mechanismβ sensor attached to the mechanism housing chamber B is checked toconfirm that the mechanism β has been drawn out (YES judgement at StepS34), then display and reproduction of the second part D-2 is performed(Step S35).

On the display of the part D-2, the operator is prompted an operation toremove the note jam from the mechanism β and set the mechanism β in themechanism housing chamber B as help information. After the display ofthe part D-2, if the operator does not click twice the mouse 40B orpress a predetermined key on the keyboard 40A (NO judgement at StepS36), a confirmation as to whether the operation corresponding to thedisplay of the part D-2 has been certainly performed or not is made(Steps S37 and S38), as described next.

Since the mechanism β does not operate normally if the mechanism β isnot set correctly in the mechanism housing chamber B, a detection signalfrom the mechanism β is first checked to confirm that the mechanism β isset in the mechanism housing chamber B (YES judgement at Step S37).Then, a detection signal from the mechanism β sensor is checked toconfirm that the not jam has been removed (Step S38).

If the note jam has not been certainly removed from the mechanism β (NOjudgement at Step S38), a part Z of contents such as "jam has not beenremoved, try once more" or the like is reproduced and displayed (StepS39). After that, the procedure returns to Step S32 where the contentsof D-1 is again reproduced.

As above, after a confirmation that the note jam has been certainlyremoved (YES judgement at Step S38), a flag representing that theprocess of the part D has been completed is set at ON in the storage 48(Step S40), then a part E that is the next help information isreproduced (Step S41 in FIG. 19).

When the process of the part D has been completed or if the operatorselects the help screen B5, the part E is reproduced and the helpscreens C5-1, C5-2, . . . are successively displayed (Step S41), wherethe operator is prompted an operation to push the mechanism housingchamber B into the body as help information.

After the display of the part E, if the operator does not click twicethe mouse 40B or press a predetermined key on the keyboard 40A (NOjudgement at Step S42), the procedure proceeds to the next help displayof the part E. At that time, it is necessary to confirm that themechanism housing chamber B has been pushed into the body. So, adetection signal from the mechanism housing chamber B sensor is checkedto conform that the mechanism housing chamber B has been pushed into thebody (YES judgement at Step S43), after that, the next help isdisplayed.

More specifically, when the operator pushes the mechanism housingchamber B into the body by referring to the help screens C5-1, C5-2, . .. and the mechanism housing chamber B sensor detects a close state, aflag representing that the process of the part E has been completed isset at ON in the storage 48 (Step S44), then the part I that is the lasthelp information is reproduced (Step S45).

If the process of the part E has been finished or if the operatorselects the help screen B6, the part I is reproduced and the helpscreens C6-1, C6-2, . . . are successively displayed. The part I is helpinformation prompting the operator to close the door A in front of theapparatus. As shown in FIG. 15, actual images of the operations aresuccessively displayed along with character displays (sound outputs)such as "not turn the key but wait . . . ", "close the door as it is",etc. (Step S45).

After the display of the part I, if the operator does not click twicethe mouse 40B or press a predetermined key on the keyboard 40A (NOjudgement at Step S46), the help guidance is finished. At that time, itis necessary to confirm that the door A is closed. So, a detectionsignal from the door A sensor is checked to confirm that the door A isclosed (YES judgement at Step S47), then the help guidance isterminated.

More specifically, when the operator closes the door A by referring tothe help screens C6-1, C6-2, . . . and the door A sensor detects a closecondition, a flag representing that the process of the part I has beencompleted is set at ON in the storage 48 (Step S48), then a display suchas "recovered" or the like is performed on the screen (Step S49), thenthe display on the CRT 42A automatically returns to the business screenA0 (Step S50).

In terms of the screens B1 through B6 through which the operatoractually worked, predetermined flags in the storage 48 are set at ON. Ifthe reproduction and display of the help screen C is interrupted and thehelp screen B is displayed, this flag is referred (Step S15 in FIG. 16),and the small screens (B1 through B6) labeled the ON flags areautomatically subjected to a special display process such as agray-colored display (Step S16). Whereby, the operator can clearlyrecognize the work having been finished, besides the operator cannotselect again the small screen in gray.

As stated above, even if the help screen A or B is displayed, when themeasures to the error in the bank note depositing/paying apparatus 20 iscompleted and the error is recovered, the sensor control unit 20E of thebank note depositing/paying apparatus 20 detects recovery from the error(YES judgement at Steps S13 and S18 in FIG. 16), a message such as"error recovered" or the like is displayed on the help screen A or Bpresently displayed (Step S49 in FIG. 19), the help screen A or B iserased from the CRT 42A, and the display on the CRT 42A automaticallyreturns to the business screen A0 (Step S50).

According to the first embodiment of this invention, the apparatusitself detects a necessity for recovery from error or medium supplementas above, and reproduction of the help guidance is automaticallyproceeded in synchronization with this so that it is possible to useautomatically the help information without bothering the operator andincrease the operation efficiency.

The function of the operation guidance information reproducing apparatusof this embodiment is provided to the terminal apparatus as statedbefore. However, the terminal apparatus is installed from the beginningfor managing the bank note depositing/paying apparatus 20. It istherefore unnecessary to newly provide an apparatus used to reproducethe detailed operation guidance information. It is therefore possible torealize accurate reproduction of the operation procedures at a low cost.

Further, it is possible to display and reproduce the help information,from a simple help explanation for the upper level operator down to thehelp information for the middle and lower level operator, stepwiselydepending on an operator's demand. It is therefore possible to providethe help information of contents in various levels meeting operators inall levels without forcing inefficient works to the operator. Theoperator can operate only by efficiently watching and listening onlynecessary information.

Still further, this operation guidance is so programmed as to avoidduplication of the same process if a plurality of errors or a necessityof medium supplement occurs, and to enable each user to customize theorder of process. Accordingly, it is possible to display the helpscreens B and C in the most efficient order.

Still further, the actual operation procedure is visualized from aviewpoint of the operator looking at the bank note depositing/payingapparatus 20 and the obtained imaged are reproduced and displayed on thehelp screen C, besides the character information and the soundinformation are reproduced simultaneously so that the multi-mediafunction is effectively used. The operator can thereby surely grasp theoperation procedure visually and aurally. In consequence, it is possibleto notify contents of the operation quite comprehensively to theoperator.

The above embodiment has been described by way of an example where anapparatus that is an object of the operation guidance is a bank notedepositing/paying apparatus. This invention is not limited to thisexample, but applicable to another business machine, similarly. In whichcase, the present invention may bring the same function and effect asthe above embodiment.

In the above-described embodiment, the operation guidance is performedwhen an error or a necessity of medium supplement occurs. It is alsopossible to guide the operation whenever the operator (the user) comesto need the operation guidance with or without a trouble in the similarmanner to the above embodiment.

In the above-described embodiment, a level of the operator iscategorized into three levels of senior, middle and beginner, and theoperation guidance is displayed in three stages depending on each level.This invention is not limited to this example, but the operationguidance may be displayed hierarchically in two stages, or four stagesor more.

(C) Description of Second Embodiment

FIG. 20 is a block diagram showing a structure of a system having anoperation guidance information reproducing apparatus as a secondembodiment of this invention. In the second embodiment shown in FIG. 20,a terminal apparatus (a work station) 50 has substantially the samefunction as the operation guidance information reproducing apparatushaving been described in the first embodiment. The terminal apparatus 50manages peripheral equipment (an object apparatus) 60. When an eventsuch as an error occurs in the peripheral equipment 60, an operationguidance (an operation guidance information) depending on the event isreproduced at the terminal apparatus 50.

According to the second embodiment, the terminal apparatus 50 isconnected to a server apparatus (an upper apparatus; another terminalapparatus, an inquiry computer, etc.) via a transmission line 65configuring a network such as a LAN. The terminal apparatus 50 isprovided information about an operation guidance to be reproduced anddisplayed from an operation guidance storing file (a database) 71connected to the server apparatus 70.

As shown in FIG. 20, the terminal apparatus 50 of this embodiment has aprocessing unit 51, a network connection control mechanism 52, acommunication mechanism 53, an input unit control mechanism 54, adisplay unit control mechanism 55 and a sound output unit controlmechanism 56.

The processing unit 51 has accesses for transmission with the LAN (thetransmission path 65) through the network connection mechanism 52,manages the peripheral equipment 60 through the communication mechanism53. In addition to these, the processing unit 51 has substantially thesame functions as the multi-media help control unit 47 having beendescribed in the first embodiment.

The input unit control mechanism 54, the display unit control mechanism55 and the sound output unit control mechanism 56 are interfaces betweenthe input unit 57, the display unit 58 and the sound outputting unit 59all connected to the terminal apparatus 50, and the processing unit 51,respectively.

The input unit 57 is configured with, for example, a mouse, a keyboard,etc., used for inputting an instruction from an operator. The displayunit 58 reproduces and displays operation guidance information indynamic images, static images, characters, etc. on a display such as aCRT or the like. The sound outputting unit 59 is configured with, forexample, a speaker, used for reproducing and outputting the operationguidance information with sound.

The peripheral equipment 60 of this embodiment has a communicationmechanism 61, an I/O mechanism 62 and an I/O control mechanism 63. Thecommunication mechanism 61 is an interface with the terminal apparatus50. The I/O mechanism 62 detects detailed conditions (an operationcondition, an error, etc.) in the peripheral equipment 60. The I/Ocontrol mechanism 63 notifies detailed information in the equipment 60detected by the I/O mechanism 62 to the terminal apparatus 50 via thecommunication mechanism 61.

The server apparatus 70 of this embodiment has a network connectioncontrol mechanism 72, a communication mechanism 73 and a guidance datasupport processing unit 74. The network connection control mechanism 72is an interface between the LAN (the transmission path 65) and theguidance data support processing unit 74. The communication mechanism 73is an interface between the operation guidance recording file 71 and theguidance data support processing unit 74.

When the guidance data support processing unit (a search path) 74receives a request to read operation guidance from the terminalapparatus 50 via the transmission line 65 and the connection mechanism72, the guidance data support processing unit 74 searches into theoperation guidance recording file 71 via the communication mechanism 73,reads the requested operation guidance information, and transfers it tothe terminal apparatus 50 via the connection mechanism 72 and thetransmission path 65.

The operation guidance recording file 71 is an external storageapparatus such as a hard disk or the like, in which data such as images,sounds, etc. to be reproduced at the terminal apparatus 50 as theoperation guidance information are stored in advance. In particular, theimage data is formed by photographing an actual manner of an operationfrom a viewpoint of the operation looking at the peripheral equipment60.

The processing unit (a reproduction control unit) 51 receives acondition of the peripheral equipment 60 (detected by the I/O mechanism62) changing with a progress of measures taken by the operator from theperipheral equipment 60, receives an operation guidance depending of aprogress of the operation in linkage with a condition of the peripheralequipment 60 from the operation guidance recording file 71, and controlsthe display unit 58 and the sound outputting unit 59 to sequentiallyreproduce it.

An operation of the apparatus according to the second embodiment havingthe above structure will be next described with reference to a flowchart(Steps S51 through S65) shown in FIG. 21.

When any trouble occurs in the peripheral equipment 60 (Step S51), theI/O mechanism 62 detects the trouble and acquires detailed errorinformation (Step S52). The detailed error information so obtained isnotified to the terminal apparatus 50 via the I/O control mechanism 63and the communication mechanism 61 (Step S53).

When the processing unit 51 of the terminal apparatus 50 acquires thedetailed error information through the communication mechanism 53 (StepS54), the processing unit 51 selects an operation guidance to bereproduced on the basis of that detailed error information (Step S55),and requests the server apparatus 70 via the transmission path 65 toread data of images and sounds to be reproduced in the selectedoperation guidance (Step S56).

When receiving a request from the terminal apparatus 50, the guidancedata support processing unit 74 of the server apparatus 70 searches intothe operation guidance recording file 71 through the communicationmechanism 73, reads out operation guidance information requested to beread (Step S57), and transfers it to the terminal apparatus 50 throughthe connection mechanism 72 and the transmission path 65 (Step S58).

When receiving the operation guidance information from the serverapparatus 70, the processing unit 51 of the terminal apparatus 50processes image data and the sound data included in the receivedoperation guidance information to obtain data in a form that can beactually reproduced (Step S59), sends it to the display unit 58 and thesound outputting unit 59 through the display unit control mechanism 55and the sound output unit control mechanism 56 to reproduce and displaythe operation guidance information as images on the display unit 58,besides reproducing and outputting the operation guidance information assounds through the sound outputting unit 59 (step S60).

The user performs a recovery work or the like on the peripheralequipment 60 by referring to the operation guidance reproduced at thedisplay unit 58 and the sound outputting unit 59 (Step S61).

When the recovery work in the part of the reproduced operation guidanceis completed (YES judgement at Step S62), the I/O mechanism 62 detectsthe condition, and notifies completion of the error recovery process tothe terminal apparatus 50 via the I/O control mechanism 63 and thecommunication mechanism 61 (Step S63). If a notification of completionof the recovery work in the part of the reproduced operation guidance isnot transmitted from the peripheral equipment 60 for a predeterminedperiod or more, the processing unit 51 of the terminal apparatus 50reproduces again the same operation guidance.

When receiving the notification of completion of the recovery work inthe part of the reproduced operation guidance, the processing unit 51 ofthe terminal apparatus 50 judges a presence of the operation guidance tobe reproduced next (Step S64). If there is no operation guidance to bereproduced next, that is, all recovery works have been completed, areproduction controlling process by the processing unit 51 isterminated. If the recovery process is in the course, an operationguidance to be reproduced in the next error recovery process is selectedagain (Step S65), and the processes at Steps S56 through S63above-described are repeated.

Likewise, the user repeats the recovery work on the peripheral equipment60 by referring to the operation guidance reproduced at the display unit58 and the sound outputting unit 59, and restores the peripheralequipment to the normal condition.

As above, the terminal apparatus 50 reproduces the operation guidanceinformation in linkage with a condition of the peripheral equipment 60so as to assist the operator who actually perform the recovery work onthe peripheral equipment 60.

When the operator needs the operation guidance, the operator inputsinformation indicating that the operation guidance is necessary throughthe input unit 57. The inputted information is notified to theprocessing unit 51 via the input control mechanism 54. The processingunit 51 receiving this information causes the display unit 58 throughthe display unit control mechanism 55 to display a selection screen forinquiring of the operator which operation guidance the operator wants.

The operator selects and designates the necessary operation guidancethrough the input unit 57 by referring to the selection screen displayedon the display unit 58. Information about the selected operationguidance is notified to the processing unit 51 through the input unitcontrol mechanism 54. The processing unit 51 selects the operationguidance to be reproduced on the basis of the notified information aboutthe operation guidance, and asks the server apparatus 70 via thetransmission path 65 to read image and sound data to be reproduced inthe operation guidance. After that, the operation guidance required bythe operator is reproduced at the display unit 58 and the soundoutputting unit 59 in a manner similar to the above manner having beendescribed with reference to FIG. 21.

According to the second embodiment of this invention, information abouta condition of recovery is notified from the peripheral equipment 60 tothe terminal apparatus 50 whenever the recovery operation is performedon the peripheral equipment 60, and an operation guidance depending on acondition of the recovery (that is, a stage of the recovery operation)is reproduced on the terminal apparatus 50. As this, necessary operationguidance is automatically reproduced without a necessity of a particularinstruction from the user through the mouse or the like so that theoperation efficiency may be largely improved.

An actual operation procedure is visualized from a viewpoint of theoperator looking at the peripheral equipment 60, and reproduced anddisplayed so that it is possible to notify contents of the operation tothe operator quite comprehensibly.

A client/server system is configured with a LAN or the like, data ofimages and sounds about the operation guidance are collectively recordedin the operation guidance recording file 71 connected to the serverapparatus 70 so as to be commonly used by each of the apparatus. It istherefore possible to save a material for the disk of the terminalapparatus (a work station) 50, and reduce a traffic on the communicationpaths between the terminal apparatus.

(D) Description of Third Embodiment

FIG. 22 is a block diagram showing a structure of a multi-mediainformation reproducing apparatus according to a third embodiment ofthis invention. The first embodiment has been described by way of anexample where data to be reproduced is deassembled into parts andstored, necessary parts are searched and combined, and an operationguidance information is formed suitably. In the apparatus of the thirdembodiment, voluntary multi-media information is deassembled into partsas above and the user combines the parts to form a voluntary multi-mediatitle.

In FIG. 22, reference numerals 81 and 82 denote an image displayapparatus (a display unit) and a sound reproducing apparatus (a soundoutput unit) for reproducing multi-media information including imageinformation and sound information, respectively.

Reference numeral 83 denotes a database. The database 83 is used tostore in advance the multi-media information in the form of parts, eachof which is a unit according to contents of the information.

According to this embodiment, the multi-media parts are configured as,for example, shown in FIG. 23. In each of the multi-media parts, aunique number with which a part can be specified is stored as key data,along with image data for one scene and sound data for one scene.Further, in each of the multi-media parts, addresses of the image dataand the sound data in that part, a length of that part, controlinformation (information used for a special effect, etc.) forreproduction of the image data and the sound data are stored as controldata.

The data base 83 is configured with a gathering of a number of themulti-media parts as shown in FIG. 24. Only by storing the key data inthe head of each multi-media data part is stored in order in a storagemedium (a sequence data storing apparatus 91 described later), anaddress of the multi-media information and an order of reproduction maybe designated. The key data which has been stored in the storage mediumand formed into a file is termed as a sequence data file, having astructure as, for example, shown in FIG. 25.

In FIG. 22, reference numeral 84 denotes an input unit such as a mouse,a keyboard, etc. used by a user to input necessary instructions toreproduce the multi-media parts in the database 83. Reference numeral 85denotes a ROM for storing a sequence data forming/updating program (asequence data forming means) 86 and a sequence data reproducing program(a sequence data reproducing means) 87 therein.

The programs 86 and 87 stored in the ROM 85 operate on a CPU not shownactually. The sequence data forming/updating program 86 operatesaccording to a flowchart described later with reference to FIGS. 27through 31. In order to determine an order of reproduction of pluralarbitrary multi-media data parts in the database 83 according to aninstruction through the input unit 84, the sequence dataforming/updating program 86 forms a sequence data file made up of keydata designating each multi-media part, and sets and stores it into thesequence data storing apparatus 91.

The sequence data reproducing program 87 operates according to aflowchart described later with reference to FIG. 32. When receiving aninstruction to start reproducing multi-media parts through the inputunit 84, the sequence data reproducing program 87 reads pluralmulti-media parts from the database 83 according to the sequence datafile having been formed by the sequence data forming/updating program 86and stored in the sequence data storing apparatus 91, and causes areproduction processing unit to successively reproduce these pluralmulti-media parts at the image display apparatus 81 and the soundreproducing apparatus 82.

Reference numeral 88 denotes a reproduction processing unit. Thereproduction processing unit 88 has functions to process variousinformation notified from the sequence data forming/updating program 86or the sequence data reproducing program 87, form image data and sounddata, transmit these image data and sound data to the image displayapparatus 81 and the sound reproducing apparatus 82 to reproduce them.In addition to these, the reproduction processing unit 88 has a functionto get an access to the sequence data storing apparatus 91 to write orread the sequence data file.

Reference numeral 89 denotes a RAM, and 90 denotes a register. The RAM89 and the register 90 are used when the reproduction processing unit 88performs a process, and adapted to store various data temporarilytherein.

An operation of the above-mentioned apparatus according to the thirdembodiment having the above structure will be next described referringto FIGS. 26 through 33.

According to this embodiment, processes by each program are, in general,carried out in order of process by the sequence data forming/updatingprogram 86 (Step S69), and a process by the sequence data reproducingprogram 87 (Step S70), as shown in FIG. 26.

A scenario of the sequence data forming/updating program 86 develops asshown in FIG. 27. According to this scenario, a program which promptsthe user to select a voluntary multi-media part is reproduced (StepS71), and a process A (Step S72; refer to FIG. 28), a process B (StepS73; refer to FIG. 29) and a process C (Step S74; refer to FIG. 30) arecontinuously carried out. Until inputs of a sequence of data partsfinishes, these processes A, B and C are repeated. After that, a processD (Step S75; refer to FIG. 31) is carried out, and a process by thesequence data forming/updating program 86 is terminated.

In the process A, a voluntary multi-media data part is selectivelyinputted by the user through the input unit 84, as shown in FIG. 28, andthe input is received (Step S76). A key data of the selected multi-mediadata part is temporarily stored in the register 90 through thereproduction processing unit 88.

The process B serves to have the user to recognize that some multi-mediadata part has been selected in the process A, and to display a name ofthe selected multi-media data part on a screen of the image display unit81. More specifically, various information of characters (a sequence ofdisplayed characters, coordinates of the display, a font and a point,and a color of characters) to be displayed is received from the sequencedata forming/updating program 86 (Steps S78 through S81). After that,characters showing the name of the multi-media part is displayed on thescreen of the image display apparatus 81 through the reproductionprocessing unit 88 (Step S82).

The process C serves to transfer the key data stored temporarily in theregister 90 in the process A to the RAM 89 as sequence data (transfer aresult of an input; Step S83). The data transferred to the RAM 89becomes an order information used when the sequence data reproducingprogram 87 reproduces the voluntary multi-media title. This is sequencedata, and its file is the sequence data file.

In the process D, the user is prompted to input a name of the sequencedata file formed this time, as shown in FIG. 31. When the name of thesequence data file is inputted through the input unit 84 (Step S84), thesequence data file on the RAM 89 is transferred along with its file nameto the sequence data storing unit 91 through the reproduction processingunit 88 and stored therein (Step S85).

When an execution of the sequence data forming/updating program 86 isterminated as in the above manner, the user can voluntarily carry outthe sequence data reproducing program 87. The sequence reproducingprogram 87 develops as shown in FIG. 32.

More specifically, plural sequence data files stored in the sequencedata storing apparatus 91 are searched, and the user is prompted toselect a voluntary sequence data file.

When a sequence data file is selected (Step S86), the selected sequencedata file is read from the sequence data storing apparatus 91 into theRAM 89 (Step S87), then a corresponding multi-media data part issearched in the database 83 on the basis of the key data in the sequencedata file (Step S88).

The searched data is read into the RAM 89 through the reproductionprocessing unit 88 (Step S89), and its image data and sound data arereproduced on the image display apparatus 81 and the sound reproducingapparatus 82 (Step S90).

The process at Steps S88 through S90 is performed on all key data in onesequence data file. When the process for key data file finishes (YESjudgement at Step S91), a process by the sequence data reproducingprogram 87 is terminated.

An operation of the above-mentioned apparatus of the third embodimentwill be next described more concretely with reference to FIG. 33. Amulti-media title shown in FIG. 33 is so formed as to be installed on acounter for attending to customers of a travel agency. With thismulti-media title, the customer can voluntarily select a city to visit,an airline to get on, and the sights to visit, and multi-mediainformation commenting these information can be reproduced anddisplayed. Incidentally, a progress of the multi-media title shown inFIG. 33 is based on a flowchart showing in FIGS. 26 through 32.

When the multi-media title of this embodiment is started, a screen asshown in FIG. 33(a) is displayed on an image display apparatus 81. Inthe title of this, two kinds of menu, "CREATE (execute a productionupdating program)" and "PLAY (execute a reproducing program)", aredisplayed. Here, "CREATE" is first selected so as to execute a sequencedata forming/updating program 86.

According to selection of "CREATE", images and sounds are outputted, aprogram is reproduced, and a screen for selecting a city to visit isdisplayed as shown in FIG. 33(b). On this occasion, if the userdesignates a certain point on the screen, the user can watch and listena list of features (main sights, spots worthy of a visit, etc.) as themulti-media information, which becomes a reference when the user decidesa city to visit. When the user selects a city to visit, a process Ashown in FIG. 28 is executed, and a result of the input is temporarilystored in the register 90. In FIG. 33(b), there is selected Paris as acity to visit.

When the user selects a city to visit, a process B shown in FIG. 29 anda process C shown in FIG. 30 are executed. A result of the input isdisplayed on the screen as shown in FIG. 33(c), besides the result ofthe input is transferred to the RAM 89 as sequence data.

Next, a screen for selecting an airline to be used is displayed as shownin FIG. 33(d). When the user designates a certain point on the screen,the user can watch and listen a list of features (a fare, menus ofmeals, special services, etc.) as the multi-media information, whichbecomes a reference when the user decides an airline. When the userselects an airline, the process A is executed as well as the above, anda result of the input is temporarily stored in the register 90.Incidentally, there is selected Japan Airline in FIG. 33(d).

When the user selects an airline, the process B and the process C areexecuted, a result of the input is displayed on the screen, besides theresult of the input is transferred as a sequence to the RAM 89 in thesame manner.

Next, a screen for selecting the sights to which the user wants to visitis displayed as shown in FIG. 33(f). When the user designates a certainpoint on the screen, the user can watch and listen the sights(spotsworthy of a visit, an expense, time, etc.) as the multi-mediainformation, which becomes a reference when the user decides the sightsto visit. When the user selects the sights to visit, the process A isexecuted as well as the above, and a result of an input is temporarilystored in the register 90. Incidentally, there is selected an EiffelTower in FIG. 33(f). When the user selects the sights, the process B andthe process C are executed. As shown in FIG. 33(g), a result of theinput is displayed on the screen, besides the result of the input istransferred as a sequence to the RAM 89.

When the user finishes selection of all items as in the above manner,the process D shown in FIG. 31 is executed, and a screen for inputting afile name of the produced sequence data is displayed as shown in FIG.33(h). When the user inputs a desiring file name and selects "RETAIN",the sequence data file retained in the RAM 89 is transferred to thesequence data storing apparatus 91 as a sequence data file having thatfile name and stored therein.

When execution of the production updating program 86 is terminated, acondition of the display on the image display apparatus 81 returns tothe initial selection menu screen as shown in FIG. 33(i). On thisscreen, the user selects "PLAY" to execute the sequence data reproducingprogram 87.

On this occasion, a process shown in FIG. 32 is executed, and allsequence data file names (indicated by an extension .SQC, as aninstance, here) in the sequence data storing apparatus 91 are searchedand displayed as shown in FIG. 33(j). The user selects a voluntarysequence data on the display. The selected sequence data file is readfrom the sequence data storing apparatus 91 out to the RAM 89.

The multi-media title is then reproduced on the basis of the sequencedata read into the RAM 89. In this example, a multi-media partillustrating the sights in Paris, a multi-media part illustratingservices provided by Japan Airline, and a multi-media part illustratingEiffel Tower are successively reproduced and outputted through the imagedisplay apparatus 81 and the sound reproducing apparatus 82.

As above, the user can watch and listen efficiently only the multi-mediainformation that the user has voluntarily selected.

According to the third embodiment of this invention, the user who knownothing about a manner to form the multi-media title can combinevoluntary multi-media parts and form a secondary multi-media titlewithout being aware of the program so as to watch and listen onlynecessary information efficiently.

It is possible to store a sequence data made up of key codes in aportable small-capacity storage medium and exchange data readily. Forthis, the multi-media title becomes more familiar and convenient to theuser and a multi-media information reproduction apparatus can be spreadwidely.

The third embodiment has been described by way of an example of amulti-media title made for the purpose of installing it on a counter forattending customers in a travel agency. This invention is not limited tothe above example, but applicable to a case where various multi-mediainformation is reproduced. In any case, the present invention may bringthe same functions and effects.

What is claimed is:
 1. An operation guidance information reproducingmethod when an event requiring measures to be taken by an operatoroccurs in an object apparatus, comprising the steps of:storing inadvance in a database measures information parts, which are obtained bydeassembling operation guidance information for the measures to be takenby the operator into parts, each of which is a minimum unit of themeasures which may be taken for said object apparatus by the operatorreading the measures information parts from the database depending onthe event; determining an order for reproducing the measures informationparts to avoid duplicates of the measures information parts, dependingon the event; and successively reproducing the measures informationparts in said order of reproduction, notifying the operator of theoperation guidance information depending on the event.
 2. The operationguidance information reproducing method according to claim 1, wherein animage obtained by visualizing one of the measures to be taken by theoperator from a viewpoint of the operator looking at the objectapparatus is displayed as said operation guidance information on apredetermined display unit.
 3. The operation guidance informationreproducing method according to claim 2, wherein character informationexplaining the one of the measures is displayed on said display unit assaid operation guidance information along with said image.
 4. Theoperation guidance information reproducing method according to claim 2,wherein sound information explaining the one of the measures isoutputted simultaneously when said image is displayed on said displayunit.
 5. The operation guidance information reproducing method accordingto claim 3, wherein sound information explaining the one of the measuresis outputted simultaneously when said image is displayed on said displayunit.
 6. The operation guidance information reproducing method accordingto claim 1, wherein said operation guidance information is reproduced ata terminal apparatus connected to said object apparatus to manage saidobject apparatus.
 7. The operation guidance information reproducingmethod according to claim 6, wherein said database is provided on a sideof an upper apparatus connected to said terminal apparatus to managesaid terminal apparatus and is used commonly by another terminalapparatus.
 8. An operation guidance information reproducing apparatuscomprising:a reproduction control unit for reading operation guidanceinformation from a database depending on an event, when the eventrequiring measures to be taken by an operator occurs in an objectapparatus, to control reproduction of said operation guidanceinformation; a reproducing unit controlled by said reproduction controlunit for reproducing said operation guidance information to notify theoperator of said operation guidance information, said operation guidanceinformation including measures information parts each of which is aminimum unit of measures to be taken for said object apparatus by theoperator, said operation guidance information being stored in advance insaid database; a searching unit for searching the measures informationparts depending on the event in said database; and an order determiningunit for determining an order for reproducing said measures informationparts searched by said searching unit to avoid duplication of the samemeasures parts; said reproducing control unit controlling successivereproduction of said measures information parts from said database inthe order of reproduction determined by said order determining unit atsaid reproducing unit.
 9. The operation guidance information reproducingapparatus according to claim 8 further comprising a display unit as saidreproducing unit for reproducing and displaying said operation guidanceinformation as an image the image being obtained by visualizing one ofthe measures from a viewpoint of the operator looking at said objectapparatus.
 10. The operation guidance information reproducing apparatusaccording to claim 9, wherein character information explaining the oneof the measures is reproduced and displayed on said display unit as saidoperation guidance information along with said image.
 11. The operationguidance information reproducing apparatus according to claim 9 furthercomprising a sound outputting unit as said reproducing unit forreproducing and outputting said operation guidance information as soundinformation, explaining the one of the measures, reproduced andoutputted from said sound outputting unit simultaneously when said imageis reproduced and displayed on said display unit.
 12. The operationguidance information reproducing apparatus according to claim 10 furthercomprising a sound outputting unit as said reproducing unit forreproducing and outputting said operation guidance information as soundinformation, explaining the one of the measures, reproduced andoutputted from said sound outputting unit simultaneously when said imageis reproduced and displayed on said display unit.
 13. The operationguidance information reproducing apparatus according to claim 8, whereinsaid database is provided on a side of an upper apparatus and is usedcommonly by another apparatus.